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A single valued neutrosophic set (SVNS) is an instance of a neutrosophic set, which give us 
an additional possibility to represent uncertainty, imprecise, incomplete, and inconsistent 
information which exist in real world. It would be more suitable to apply indeterminate 
information and inconsistent information measures. In this paper, the cross entropy of 
SVNSs, called single valued neutrosophic cross entropy, is proposed as an extension of 
the cross entropy of fuzzy sets. Then, a multicriteria decision-making method based on 
the proposed single valued neutrosophic cross entropy is established in which criteria val- 
ues for alternatives are SVNSs. In decision making process, we utilize the single-valued 
neutrosophic weighted cross entropy between the ideal alternative and an alternative to 
rank the alternatives corresponding to the cross entropy values and to select the most 
desirable one(s). Finally, a practical example of the choosing problem of suppliers is pro- 
vided to illustrate the application of the developed approach. 

© 2013 Elsevier Inc. All rights reserved. 



1. Introduction 

Entropy is very important for measuring uncertain information. The fuzzy entropy was first introduced by Zadeh [1,2]. 
The starting point for the cross entropy approach is information theory as developed by Shannon [3], Kullback-Leibler [4] 
proposed a measure of the “cross entropy distance” between two probability distributions. Later, Lin [5] proposed a modified 
cross-entropy measure. Shang and Jiang [6] proposed a fuzzy cross entropy measure and a symmetric discrimination infor- 
mation measure between fuzzy sets. As an intuitionistic fuzzy set is a generalization of a fuzzy set, Vlachos and Sergiadis [7] 
proposed an intuitionistic fuzzy cross-entropy based on an extension of the De Luca-Termini nonprobabilistic entropy [8] 
and applied it to the pattern recognition, medical diagnosis, and image segmentation. Then, Zhang and Jiang [9] defined a 
vague cross-entropy between vague sets (VSs) by analogy with the cross entropy of probability distributions and applied 
it to the pattern recognition and medical diagnosis, and then Ye [10] has investigated the fault diagnosis problem of turbine 
according to the cross entropy of vague sets. Furthermore, Ye [11] has applied the intuitionistic fuzzy cross entropy to mul- 
ticriteria fuzzy decision-making problems. Ye [12] proposed an interval-valued intuitionistic fuzzy cross-entropy based on 
the generalization of the vague cross-entropy [9] and applied it to multicriteria decision-making problems. 

Smarandache [13] originally introduced neutrosophy. It is a branch of philosophy which studies the origin, nature and 
scope of neutralities, as well as their interactions with different ideational spectra. Neutrosophic set is a powerful general 
formal framework, which generalizes the concept of the classic set, fuzzy se, interval valued fuzzy set, intuitionistic fuzzy 
set, interval-valued intuitionistic fuzzy set, paraconsistent set, dialetheist set, paradoxist set, and tautological set [13]. In 
the neutrosophic set, indeterminacy is quantified explicitly and truth-membership, indeterminacy-membership, and 
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falsity-membership are independent. This assumption is very important in many applications such as information fusion in 
which the data are combined from different sensors. Recently, neutrosophic sets had mainly been applied to image process- 
ing [14,15] in engineering field. 

intuitionistic fuzzy sets and interval valued intuitionistic fuzzy sets can only handle incomplete information but not the 
indeterminate information and inconsistent information which exist commonly in real situations. For example, when we ask 
the opinion of an expert about certain statement, he or she may that the possibility that the statement is true is between 0.5 
and 0.7, and the statement is false is between 0.2 and 0.4, and the degree that he or she is not sure is between 0.1 and 0.3. For 
neutrosophic notation, it can be expressed as x([0.5,0.7], [0.1, 0.3], [0.2, 0.4]). Here is another example, suppose there are 10 
voters during a voting process. In time t,, four vote “yes”, three vote “no” and three are undecided. For neutrosophic nota- 
tion, it can be expressed as x(0.4,0.3,0.3); in time t 2 , two vote “yes”, three vote “no”, two give up, and three are undecided, 
then it can be expressed as x(0.2,0.3,0.3). The mentioned information is beyond the scope of the intuitionistic fuzzy set. So 
the notion of neutrosophic set is more general and overcomes the aforementioned issues. 

The neutrosophic set generalizes the above mentioned sets from philosophical point of view. From scientific or engineer- 
ing point of view, the neutrosophic set and set-theoretic operators need to be specified. Otherwise, it will be difficult to apply 
in the real applications. Therefore, Wang et al. [16] proposed a single valued neutrosophic set (SVNS) and provide the set- 
theoretic operators and various properties of SVNSs. Recently, Ye [17] proposed Similarity measures between interval neu- 
trosophic sets and applied them to multicriteria decision-making problems under the interval neutrosophic environment. 

On one hand, a SVNS is an instance of a neutrosophic set, which give us an additional possibility to represent uncertainty, 
imprecise, incomplete, and inconsistent information which exist in real world. It would be more suitable to apply indeter- 
minate information and inconsistent information measures in decision-making. However, the connector in the fuzzy set is 
defined with respect to T, i.e. membership only, hence the information of indeterminacy and nonmembership is lost. The 
connectors in the intuitionistic fuzzy set are defined with respect to T and F, i.e. membership and nonmembership only, 
hence the indeterminacy is what is left from 1. While in the SVNS, they can be defined with respect to any of them (no 
restriction). So the notion of SVNSs is more general and overcomes the aforementioned issues. On the other hand, SVNSs 
can be used for the scientific and engineering applications because SVNS theory is valuable in modeling uncertain, impreci- 
sion and inconsistent information. Due to its ability to easily reflect the ambiguous nature of subjective judgments, the SVNS 
is suitable for capturing imprecise, uncertain, and inconsistent information in the multicriteria decision-making analysis. 
However, to the best of our knowledge, there is no work addressing the multicriteria decision-making problems in single 
valued neutrosophic setting. Therefore, the main purposes of this paper were (1 ) to present the cross entropy of SVNSs, called 
single valued neutrosophic cross-entropy, and (2) to establish a multicriteria decision-making method by use of the cross 
entropy of SVNSs. In the decision-making process, we utilize the single-valued neutrosophic weighted cross entropy be- 
tween the ideal alternative and an alternative to rank the alternatives corresponding to the cross entropy values, and to se- 
lect the most desirable one(s). 

The rest of paper is organized as follows. In Section 2, we introduce the some concepts of neutrosophic sets and SVNSs, 
and some operators for SVNSs. In Section 3, a cross-entropy measure between SVNSs (called single valued neutrosophic 
cross-entropy) is proposed as an extension of the fuzzy cross entropy measure. Section 4 establishes a multicriteria deci- 
sion-making method based on the proposed cross-entropy of SVNSs. In Section 5, a practical example of the choosing prob- 
lem of suppliers is given to illustrate the application of the developed approach. Finally, some final remarks and further work 
are given in Section 6. 

2. Some concepts of neutrosophic sets and SVNSs 

2.3. Neutrosophic sets 

Neutrosophic set is a part of neutrosophy, which studies the origin, nature, and scope of neutralities, as well as their inter- 
actions with different ideational spectra [13], and is a powerful general formal framework, which generalizes the above men- 
tioned sets from philosophical point of view. 

Smarandache [13] gave the following definition of a neutrosophic set. 

Definition 1 [13]. LetXbe a space of points (objects), with a generic element inX denoted by x. A neutrosophic set A inX is 
characterized by a truth-membership function T A (x), a indeterminacy-membership function l A (x), and a falsity-membership 
function F A (x). The functions T A (x), I A (x) and F A (x) are real standard or nonstandard subsets of ]0 _ ,l + [. That is T A (x ): 
X -> [0 , l + [, I A (x ): X [0 , l + [, and F A (x): X -► ]0“, l + [. 

There is no restriction on the sum of T A (x), I A (x) and F A (x), so 0 sup T A (x) + sup I A (x ) + sup F A (x) ^ 3 + . 

Definition 2 [13J. The complement of a neutrosophic set A is denoted by A c and is defined as T A (x) = {1 + } e T A (x), 
3/(x ) = {1 + } e I A (x), and F/(x) = {1 + } e F A (x) for every x in X. 



Definition 3 [13], A neutrosophic set A is contained in the other neutrosophic set B, A c B if and only if inf T A (x ) ^ inf T B (x), 
sup T/ i(x) < sup T B (x), inf I A (x) > inf / B (x), sup I A (x) > sup / B (x), inf F A (x ) > inf f B (x), and sup F A (x ) > sup f B (x) for every x in X. 
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2.2. Single valued neutrosophic sets 

A SVNS is an instance of a neutrosophic set, which can be used in real scientific and engineering applications. In the fol- 
lowing, we introduce the definition of a SVNS [16], 

Definition 4 [16]. Let X be a space of points (objects) with generic elements in X denoted by x. A SVNS A in X is characterized 
by truth-membership function T A (x), indeterminacy-membership function I A (x), and falsity-membership function F A (x). For 
each point x in X, T A (x), I A (x), F A (x ) e [0, 1 ]. 

Therefore, a SVNS A can be written as 
A={(x,r A (x),I A (x),F,,(x)>|xeX}. 

The following expressions are defined in [16] for SVNSs A, B: 

(1) A C B if and only if T A (x ) <: T B (x), I A (x ) > / B (x), F A {x ) > F B (x) for any x in X, 

(2) A = B if and only if A c B and BcA, 

(3) A c = {(x,F a (x), 1 - Ia(x), T a (x))\x 6 X}. 

For convenience, a SVNS A is denoted by the simplified symbol A = ( T A (x ), l A (x ), F A (x)) for any x in X. For two SVNSs A and B, the 
operational relations are defined by [16] 



(1) A u B = (max(T A (x),T B (x)), min(hi(x),/ B (x)), min(F/i(x),F B (x)) ) for any x in X, 

(2) A n B = (min(T A (x),T B (x)), max(I A (x),I B (x)), max(F A (x),F B (x ))) for any x in X, 

(3) A x B = (T a (x) + T b (x) - T a (x)T b (x), 1 a (x)1 b (x),F a (x)F b (x)) for any x in X. 

Wang et al. [16] defined the two operators of truth-favorite (A) and falsity-favorite (V) to remove the indeterminacy in the 
single valued neutrosophic sets and transform them into intuitionistic fuzzy sets or paraconsistent sets. These two operators 
are unique on single valued neutrosophic sets, which are given as [16] 



(1) AA = (min(T/i(x) + /^(x/.lJ.O.F^x)) for any x in X, 

(2) VA = (T/i(x),0,min(F A (x) + I A (x), 1)) for any x inX. 

3. Cross-entropy between SVNSs 

This section proposes cross-entropy and discrimination information measures between two SVNSs based on the exten- 
sion of the concept of cross-entropy between two fuzzy sets. 

To do this, we firstly introduce the concepts of cross-entropy and symmetric discrimination information measures be- 
tween two fuzzy sets which were proposed by Shang and Jiang [6], 



Definition 5 [6]. Assume that A = (A(x 1 ),A(x 2 ), . . .,A(x n )) and B = (B(x 1 ),6(x 2 ),. . .,B(x n )) are two fuzzy sets in the universe of 
discourse X = {xi,x 2 , . . ,,x n ). The fuzzy cross entropy of A from B is defined as follows: 



nt/V 



i=l 



( 1 ) 



which indicates the degree of discrimination of A from B. 

However, H(A,B) is not symmetric with respect to its arguments. Shang and Jiang [6] proposed a symmetric discrimina- 
tion information measure: 



/(A, B) = H(A, B) + H(B, A). 



( 2 ) 



Moreover, there are I(A,B) > 0 and /(A,B) = 0 if and only if A = B. 

Then, the cross-entropy and symmetric discrimination information measures between two fuzzy sets are extended 
to these measures between SVNSs. In order to do so, let us consider two SVNSs A and B in a universe of discourse 
X= {X|,x 2 , . . „x n }, which are denoted by A = { (x,- . T A (Xi).I A (Xj). F A (Xj))\Xj eX} andB = { <x,- , T B (x,-) , i B (x,-) , F B (x,-) ) |x, e X}, where T A (- 
Xj), Ux,-), F/ i(x,'), T b (x,), / b (x,), F B (Xj) e [0,1] for every x, eX. The information carried by the truth-membership, the indetermi- 
nacy-membership, and the falsity-membership in SVNSs A and B can be considered as fuzzy spaces with the three elements. 
Thus based on Eq. (1), the amount of information for discrimination of T A (Xj) from T B (x,) (i = 1,2,. . ,,n) can be given by 



E T (A.B;x i ) = T A (x i ) log 2 



MXi) 

Tb(xi) 



+ (1 — T A (Xi))log 2 



1 - T a (x,) 

1-1 (T A (Xi) + Ts(xO) ’ 



( 3 ) 



Therefore, the expected information based on the single membership for discrimination of A against B is expressed by 
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E T (A,B) = '£ 



r A (x,-)iog 2 5^4 + (i - r„(Xi))iog 2 

1 B(Xi) 



1 - T a (x ,) 



1 -l(T A ( Xi ) + T B ( Xi )) 



(4) 



Similarly, considering the indeterminacy-membership function and the falsity-membership function, we have the follow- 
ing amounts of information: 



E , (A.B) = ]T 



E f (A,B) = £ 



I A (Xi) log 2 ^+(l— /4Xi))log 2 , 1 1a(X,) 



Fa(x,)log : 



Fa(H) 

F B (Xi) 



1-1 (I A (x,) + I B m 



(1 - F„(Xj))log 2 



1 - E a (x,) 



l-liF^+FeiXi)) 



(5) 



( 6 ) 



Hence, a novel single valued neutrosophic cross-entropy measure between A and B is obtained as the sum of the three 
amounts: 



E(A.B) =]T 

i=l 

n 

+E 

!=1 

n 

+E 



r A (Xi)iog 2T 



T A (X i) 



la(Xi)log 2T 



2(UXi) + T B (Xi)) 

I A (Xi) 



fa(x,)log 2 T 



2 (I a (xi) + I B (X j)) 
F A (Xi) 



+ (i - r A (x,))iog 2 
(1 - /a(x,))log 2 



1 - T a (x,) 



1 -^(T A (Xi) + T B (Xi)) 
1 - I A (Xi) 



1-1 (I A (Xi)+I B (X,)) 



i(F A (x,)+F B (x,)) 



■ (1 - F /) (x,))log 2 



1 - F A (Xi) 



1 -i(F A (xk) +F«(X|)) 



(7) 



which also indicates discrimination degree of A from B. According to Shannon’s inequality [5], one can easily prove that 
£(A,B) 0, and £(A,B) = 0 if and only if T A (Xj ) = T B (x,), I A (x f ) = / B (x,), and F A (Xj) = F B (x,) for any x,- g X. Moreover, we can easily 

see that £(A C ,B C ) = £(A,B ), where A c and B c are the complement of SVNSs A and B, respectively. 

Then, £(A,B) is not symmetric. So it should be modified to a symmetric discrimination information measure for SVNSs as 

D(A, B) = E(A, B)+E(B, A). (8) 

The larger the difference between A and B is, the larger D{A,B ) is. 



4. Multicriteria decision-maldng method based on the cross-entropy of SVNSs 

A multi-criteria decision making problem is the process of finding the best alternative from all of the feasible alternatives 
where all the alternatives can be evaluated according to a number of criteria or attributes. In general, the multi-criteria deci- 
sion making problem includes uncertainty, imprecise, incomplete, and inconsistent information which exist in real world. 
Then SVNS can represent this information. In this section, we present a handling method for the multicriteria decision-mak- 
ing problem under single valued neutrosophic environment (or called a single valued neutrosophic multicriteria decision- 
making method) by means of the proposed cross entropy measure of SVNSs. 

Let A = {A 1 ,A 2 ,. . . ,A m } be a set of alternatives and C = {C,,C 2l . . ,,C n } be a set of criteria. Assume that the weight of the cri- 
terion Cj(j = 1,2,. . ,,n), entered by the decision-maker, is Wj, w 2 g [0,1] and 5Zj"=i x j = 1- In this case, the characteristic of the 
alternative A, (i = 1,2,. . ,,m) is represented by the following SVNS: 

A,- = {{Cj,T A .(Cj),I Al (Cj),F A .(Cj))ICj e C}, 

where T Ai (Cj), I Ai (Cj), F Aj (Cj) g [0,1], j = 1,2,. . ,,n, and i = 1,2,. . ,,m. Here, T Aj (Cj) indicates the degree to which the alternative 
A, satisfies the criterion Cj, I Aj (Cj) indicates the indeterminacy degree to which the alternative A, satisfies or does not satisfy 
the criterion Cj, F Ai (Cj) indicates the degree to which the alternative A, does not satisfy the criterion Cj. For the sake of sim- 
plicity, a criterion value (Cj,T Ai (Cj),I Al (Cj),F Ai (Cj)) in A, is denoted by the symbol ay = ( Ty.Iy.Fy ) (j = 1,2 n, and i= 1,2,. . ,,m ), 

which is usually derived from the evaluation of an alternative A, with respect to a criterion Cj by means of a score law and 
data processing in practice [12,17]. Therefore, we can elicit a single valued neutrosophic decision matrix A = (a,j) mxn : 



/ a n 


CI 12 • 


■ din \ 




( (T„,/„,F„) 


(TuJu,Fu) 


(Tin, /in, Fin) N 


a 2 i 


a 22 • 


' 02n 


— 


(F 2 i,/ 2 i,F 2 i) 


(T 22 ,/ 22 ,F 22 > 


(T2n,hn,F2n) 


V a ml 


a m2 ’ 


Gmn } 




V (Fml , fml , F m l) 


(7'm2,fm2,F m2 ) • 


(Tmni Imrh F mn ) / 



In multicriteria decision-making environments, the concept of ideal point has been used to help identify the best alter- 
native in the decision set. Although the ideal alternative does not exist in real world, it does provide a useful theoretical con- 
struct against which to evaluate alternatives [12]. Hence, we can define an ideal criterion value aj = (t*,I’,FJ 'j = (1,0,0) 
(/ = 1,2 n) in the ideal alternative A*. 



Please cite this article in press as: J. Ye, Single valued neutrosophic cross-entropy for multicriteria decision making problems, Appl. Math. 
Modell. (2013), http://dx.doi.Org/10.1016/j.apm.2013.07.020 





ARTICLE IN PRESS 



J. Ye /Applied Mathematical Modelling xxx (2013) xxx-xxx 



5 



Thus, by applying Eqs. (7) and (8) the weighted cross entropy between an alternative Ai and the ideal alternative A* can be 
expressed by 



D t (A\A,) = 

j=i 



log2 i( 1+ T 0 .) + 1Og2 l-i(/,) + l ° g2 l-I(F 0 .) 



+E w j 

j = 1 

n 

+E w j 

j=i 



T,, 



1 - Ta 



“ 10 g 2 i(l+To) + (1 Ts) 1 ° g 2 l-I(l+T,y) 

s+(1 - fff)l0g2 ^rft) 



+E 

j=i 



w. 



1 - Ii, 






( 9 ) 



Therefore, the smaller the value of Di(A*,Ai) is, the better the alternative A t is. In this case, the alternative A t is close to the 
ideal alternative A*. Through the weighted cross entropy Dj(A*,A,-) (i = 1,2,. . ,,m) between each alternative and the ideal alter- 
native, the ranking order of all alternatives can be determined and the best one can be easily identified as well. 



5. Practical example 

In order to demonstrate the application of the proposed approach, a multi-criteria decision making problem adapted from 
Tan and Chen [18] is concerned with a manufacturing company which wants to select the best global supplier according to 
the core competencies of suppliers. Now suppose that there are a set of four suppliers A = {A 3 ,A 2 ,A 3 ,A 4 } whose core compe- 
tencies are evaluated by means of the following four criteria (Ci,C 2 ,C 3 ,C 4 ): 

(1) the level of technology innovation (Ci), 

(2) the control ability of flow (C 2 ), 

(3) the ability of management (C 3 ), 

(4) the level of service (C 4 ). 



Then, the weight vector for the four criteria is w = (0.3,0.25,0.25,0.2). 

The proposed decision making method is applied to solve this problem for selecting suppliers. 

For the evaluation of an alternative A,- (i = 1,2, 3, 4) with respect to a criterion Q (J = 1,2, 3, 4), it is obtained from the ques- 
tionnaire of a domain expert. For example, when we ask the opinion of an expert about an alternative A i with respect to a 
criterion Cj, he or she may say that the possibility in which the statement is good is 0.5 and the statement is poor is 0.3 and 
the degree in which he or she is not sure is 0.1. For the neutrosophic notation, it can be expressed as an = (0.5, 0.1, 0.3). Thus, 
when the four possible alternatives with respect to the above four criteria are evaluated by the similar method from the ex- 
pert, we can obtain the following single valued neutrosophic decision matrix A: 



/ (0.5, 0.1, 0.3) 
(0.4, 0.2, 0.3) 
(0.4, 0.3, 0.1) 

V (0.6, 0.1, 0.2) 



(0.5, 0.1, 0.4) 
(0.3, 0.2, 0.4) 
(0.5, 0.1, 0.3) 
(0.2, 0.2, 0.5) 



(07,0.1,0.2) 
(0.9, 0.0, 0.1) 
(0.5, 0.0, 0.4) 
(0.4, 0.3, 0.2) 



(0.3,0.2,0.1)\ 
(0.5,03,0.2) 
( 0 . 6 , 0 . 2 . 0 . 2 ) 
(07,0.2,0.1 )/ 



By applying Eq. (9), the cross entropy values between an alternative A t (i = 1,2, 3, 4) and the ideal alternative A* are as 
follows: 

D,(A*. A,) = 1.1101, D 2 (A*, A 2 ) = 1.1801, D 3 (A*. A 3 ) = 0.9962, and D 4 (A*, A 4 ) = 1.2406. 



According to the cross entropy values, thus the ranking order of the four suppliers is A 3 , A,, A 2 , and A 4 . Hence, the best 
supplier is A 3 . 

From the example, we can see that the proposed single valued neutrosophic multicriteria decision-making method is 
more suitable for real scientific and engineering applications because it can handle not only incomplete information but also 
the indeterminate information and inconsistent information which exist commonly in real situations. The technique pro- 
posed in this paper extends existing fuzzy decision-making methods and provides a new way for decision-makers. 



6. Conclusion 

SVNS is an instance of a neutrosophic set, which give us an additional possibility to represent uncertainty, imprecise, 
incomplete, and inconsistent information which exist in real world, it would be more suitable to apply indeterminate infor- 
mation and inconsistent information measures. Hence, we have proposed a single valued neutrosophic cross-entropy mea- 
sure and established its multi-criteria decision making method based on the proposed cross entropy under single valued 
neutrosophic environment, where the characteristics of alternatives on criteria are represented by SVNSs. Finally, a practical 
example was given to illustrate the application of the proposed multicriteria decision making method. 
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The proposed method differs from previous approaches for fuzzy multi-criteria decision making not only due to the fact 
that the proposed method use the SVNS theory, but also due to the consideration of the indeterminacy information besides 
truth and falsity information in the evaluation of the alternative with respect to criteria, which makes it have more feasible 
and practical than other traditional decision making methods in real decision making problems. Therefore, its advantage is 
easily reflecting the ambiguous nature of subjective judgments because SVNSs are suitable for capturing imprecise, uncer- 
tain, and inconsistent information in the multicriteria decision-making analysis. In the future, we shall investigate single- 
valued neutrosophic multicriteria group decision-making problems and apply the single valued neutrosophic cross entropy 
to solve practical applications in other areas such as expert system, information fusion system, and medical diagnoses. 
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